On demand visual recall of objects/places

ABSTRACT

Aspects of the subject disclosure may include, for example, observing a plurality of objects viewed through a smart lens, wherein the plurality of objects are in a frame of an image viewed by the smart lens, determining an identification for an object of the plurality of objects, assigning tag information for the object based on the identification, storing the tag information for the object and the frame in which the object was observed, receiving a recall request for the object, retrieving the tag information for the object and the frame responsive to the receiving the recall request, and displaying the tag information and the frame. Other embodiments are disclosed.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.17/153,952, filed on Jan. 21, 2021, which is a continuation of U.S.patent application Ser. No. 16/781,700, filed on Feb. 4, 2020, now U.S.Pat. No. 10,929,672, which is a continuation of U.S. patent applicationSer. No. 16/036,263, filed on Jul. 16, 2018, now U.S. Pat. No.10,592,746, which is a continuation of U.S. patent application Ser. No.15/436,940, filed on Feb. 20, 2017, now U.S. Pat. No. 10,055,644. Thecontents of each of the foregoing are hereby incorporated by referenceinto this application as if set forth herein in full.

FIELD OF THE DISCLOSURE

The subject disclosure relates to a system and method for organizingcontent viewed through smart lenses.

BACKGROUND

Various conventional forms of smart lens technology can record contentwhile the wearer observes objects and places around him.

BRIEF DESCRIPTION OF THE DRAWINGS

Reference will now be made to the accompanying drawings, which are notnecessarily drawn to scale, and wherein:

FIG. 1 depicts an illustrative embodiment of system 100;

FIG. 2 depicts an illustrative embodiment of a method used in portionsof the system described in FIG. 100;

FIG. 3 depicts an illustrative embodiment of a method used in portionsof the system described in FIG. 100;

FIG. 4 depicts illustrative embodiments of a communication system thatprovide media services according to system 100 and methods 200 and 300of FIGS. 2-3;

FIG. 5 depicts an illustrative embodiment of a web portal forinteracting with the communication systems of system 100 and methods 200and 300 of FIGS. 2-3;

FIG. 6 depicts an illustrative embodiment of a communication device;

FIG. 7 is a diagrammatic representation of a machine in the form of acomputer system within which a set of instructions, when executed, maycause the machine to perform any one or more of the methods describedherein; and

FIG. 8 depicts an illustrative embodiment of a method used in portionsof the system described in FIG. 100.

DETAILED DESCRIPTION

The subject disclosure describes, among other things, illustrativeembodiments for recording and providing a recall function for wearablecamera devices. Other embodiments are described in the subjectdisclosure.

One or more aspects of the subject disclosure include a method forobserving a plurality of objects viewed through a smart lens, whereinthe plurality of objects are in a frame of an image viewed by the smartlens, determining an identification for an object of the plurality ofobjects, assigning tag information for the object based on theidentification, storing the tag information for the object and the framein which the object was observed, receiving a recall request for theobject, retrieving the tag information for the object and the frameresponsive to the receiving the recall request, and displaying the taginformation and the frame.

One or more aspects of the subject disclosure include a device thatincludes a processing system including a processor and a memory thatstores executable instructions that, when executed by the processingsystem, facilitate performance of operations that include receiving aplurality of frames viewed by a smart lens device, wherein the framesinclude a plurality of objects, assigning an object tag of plurality ofobject tags for an object of the plurality of objects, assigning, as atagged frame, the object tag to a frame of the plurality of frames whenthe object is in the frame, receiving a recall request from the smartlens device, wherein the recall request includes an identity of anobject to be recalled, determining, as a requested tag, which object tagof the plurality of object tags corresponds to the recall request,retrieving the requested tag and a requested tagged frame responsive tothe receiving the recall request, and providing the requested tag andthe requested tagged frame to the smart lens device, wherein the smartlens device displays the requested tag and the requested tagged frame.

One or more aspects of the subject disclosure include a machine-readablestorage medium, including executable instructions that, when executed bya processing system including a processor, facilitate performance ofoperations that include observing a plurality of objects viewed througha smart lens, wherein the plurality of objects are in a frame of animage viewed by the smart lens, determining an identification for anobject of the plurality of objects, assigning tag information for theobject based on the identification, storing the tag information for theobject and the frame in which the object was observed, receiving arecall request for the object, retrieving the tag information for theobject and the frame responsive to the receiving the recall request, anddisplaying the tag information and the frame.

FIG. 1 illustrates an exemplary embodiment of system 100. Referring toFIG. 1, system 100 can include a local device 110. Local device 110 caninclude a wearable smart lens 114, such as a wearable smart contact lensor a wearable camera device. Exemplarily, local device 110 can include aprocessor or processing system that can communicate images or framesfrom the camera device via a transceiver to the Internet or othercomputing systems, such as a server or a local computer. Exemplarily,the wearable smart lens 114 can include a display device to displayimages to the user while being worn. In other embodiments, imagescaptured by the wearable smart lens 114 can be displayed at otherdisplay devices associated with the wearable smart lens 114, computer,or server. Exemplarily, a graphical user interface can be provided sothe wearer can operate the various function of the wearable smart lens114. In some embodiments, the wearable smart lens 114 can include anintermediary device to perform some or all of the necessary processingfunctions to operate and to communicate with other devices.

In some embodiments, the wearable smart lens 114 can include the abilityto record images seen by the wearer. In additional embodiments, thewearable smart lens 114 can provide a display device to provide imagesto the wearer while the wearable smart lens 114 is being worn.Exemplarily, an audio prompt 120 can be received or provided. The audioprompt 120 can be received via a microphone or provided via a speaker.

In some embodiments, the audio prompt 120 can indicate to the wearerthat an object is visible. In other embodiments, the audio prompt 120can be an instruction to tag or otherwise identify and object that isvisible to the wearable smart lens 114. For example, the display devicecan provide a visual prompt for the wearer to identify an observedobject. The wear can then provide an audio prompt 120 which includesinstructions containing the proper tag and itemization of the object.

Exemplarily, information gathered from the local device 110 can beprovided to a central system, such as the cloud system 120. In someembodiments, the central system can simply be a local computing systemor a server connected to other computing devices. The cloud system 120can include a controller 122. The controller 122 can include a contenttagger portion 124 and a tag retrieval portion 126. Exemplarily, thecontent tagger portion 124 can record and store identifying data ofobjects observed by the wearable smart lens 114. Exemplarily, the tagretrieval portion 126 can receive requests from the local device 110 orthe wearable smart lens 114 to retrieve the identifying data via adatabase 140 associated with the controller 122. In addition, thecontent tagger 124 can communicate with external devices through an API130 for additional services.

FIG. 2 illustrates an exemplary method 200 that system 100 of FIG. 1 canperform. Exemplarily, in Step 210, the wearable smart lens 114 of FIG. 1can scan an environment for objects. The scan includes the environment,including the images of the environment itself as well as images ofobjects captured within the environment. Exemplarily, the wearable smartlens 114 follows the head movement and/or eye movements of the wearer torecord what the wearer sees.

Next in Step 220, the system 100 can determine the identity of what theobjects are. That is, objects can be sorted according to type and usage.For example, the objects can be identified personal items such as booksor keys. In other examples, the objects can be identified as a class ofobjects, such as books versus magazines. For example, the Cloud canprovide connection management for database storage, an object index foruniverse (like a universal product catalog, Amazon™ for instance), a tagmap for all users in household, and image processing, among otherservices.

In Step 230, tags can be assigned based on user input or according to alearning engine process in which the context and knowledge of the usercan be used to predict what tag to apply to the object. For example, aTag Map can be built automatically through inferred and triggeredinsights between the user and the object. For example, in one inferredinsight: Person X uses Object “A” exclusively. Object is tagged asPerson X's Object A (as illustrated in FIG. 8: “my keys”). In anotherexample, a triggered insight can include: Person X calls Object B by anickname frequently. Object B is tagged with this nickname, such as“favorite shirt”. Exemplarily, the tagging process can use NaturalLanguage Processing (NLP).

Examples of tags can include:

-   Date or time information;-   Location information;-   Object information;-   Object Tags “H” information (such as [book], [coffee cup], or    [keys]);-   Observed By (user/device that made this observation) information;-   Image Fragment (i.e., a section of raw image that has object in it)    information; and/or-   Links to Full Captured image (ref to separate table of just    unsegmented images).-   Next, in Step 240, the identities of these objects and their tags    can be stored in the database 140 for retrieval at a future point in    time.

FIG. 3 illustrates a method 300 that can be exemplarily used inconjunction with system 100. The local device 110 can receive a requestfor a recall of an object in Step 302. The request can be a verbalrequest received via a microphone associated with the local device 110.Step 302 can include an activation that is reactive in which the userasks for the location of an object. Step 302 can include an activationthat is passive wherein the user is observed searching locations that anobject or objects is frequently found in. For example, the user can besearching on top of dresser on which the user frequently places hiskeys. Step 302 can include an activation that is proactive in nature inwhich the user is known to be performing an activity that requires anobject that the user does not currently possess. For example, the usermay be approaching a store without his wallet or a car without his keys.

In Step 304 a tag is determined for the subject of the request forrecall. Thus, if a user requests a last known location for lost keys,the appropriate tags for user keys can be determined in Step 306.Accordingly, the database can be searched for the appropriate tags. Thisprocess can include a gathering step in which all information on wantedobjects could be collected, including from across multiple users in ahousehold or office environment. Interactions between relevant objectsand other tagged objects can be ascertained. For example, a frequentstorage location or a correlation between activities and objects can bedetermined. Thus, a desk on which keys are stored can be identified as akey storage location. In another example, it is known that a userrequires his wallet to go to a store or to drive a car.

In some embodiments, a user-agnostic time-line of wanted objects can becreated. The time-line of wanted objects can include a timeline of ashifting locations for objects that have been observed. In someinstances, text can be displayed on or near the observed objects toidentify objects related to the search, such as indicating a location atwhich a wanted object is frequently found. Additionally, a streamingplayback of the object's life story can be created based on observationsof the object by the user and other users. The life story illustrateswhat has happened to the object.

In Step 308, the database can be searched for record of those tags. Aselection of relevant locations in the database can be retrieved in step310. These relevant selections can be presented to the user so that thewearer can choose which instance to view. In other embodiments, thesystem can select from the relevant instances to present a mostapplicable or appropriate instance. In Step 312, the selected video clipcan be retrieved. In Step 314, the visualization can be provided to thewearer.

In additional embodiments, the alternative steps illustrated with dashedlines can occur. For example, once the objects are retrieved in Step308, Step 320 can access a database composed of advertising contentrelated to the category for which the object is relevant. In additionalembodiments, Step 320 can be accessed once a request for the object hasbeen received in Step 302 or after receiving an additional inquiry aboutthe object in Step 318. For example, if the wearer questions thelocation of a missing item, the wearer could further articulate arequest to simply buy a replacement for that item. In other instances,advertising related to the object could be retrieved.

In other embodiments, objects not currently being considered by thewearer could nonetheless activate the process. In some embodiments, theobservation by the device of an item could activate the processindependently. Thus, if the wearer observes a particular product, anadvertising session could be activated for that product. In someinstances, the wearer may observe an advertisement for a product and aninquiry about that ad could initiate the retrieval of advertisingmaterials for that product from the database.

Next, in Step 322, it is determined if there is advertising for theobject in question. Thus, the database could be accessed for advertisingbased on the object's categorizations or other relevant data. Then, inStep 324, the content could be retrieved and displayed on the display inStep 326. For example, the ad could be displayed in the visualization ofStep 314 or independently of the visualization.

Exemplarily embodiments can include the ability to review a scenecurrently being viewed against other scenes in the past to determine achange in the observed environment. Thus, in one embodiment, a verbalcommand can ask “what has changed” and two or more scenes can becompared to determine if an item has been added or deleted from a scene.In other embodiments, the type of search can be further clarified toexclude some object types or to otherwise focus on only some objecttypes. In addition, the time frame for which scenes can be compared canbe clarified. For example, a user could request a change in number ofbooks on a desk between scenes captured one week ago and a currentlycaptured scene.

Exemplarily, smart lens technology can include wearable glasses andwearable contact lenses that unobtrusively can record, via a videorecording, the very objects and scenery that the wearer of the smartlenses are viewing as the wearer observes them. In additionalembodiments, body mounted cameras and other video recording devices canalso be accessed.

Exemplarily, as video content of the environment which the wearer isobserving is recorded, embodiments of the present invention can catalogobjects as they are viewed. These objects can be cataloged according toa location at which the object is observed. Exemplarily, the locationcan be mapped to the wearer's routines, the wearer's friends androutines of interconnected friends and relatives, and the movement ofthe wearer through the day. The objects can be cataloged according to atime marker related to when the object was is observed. Additionally,the object can be categorized according to the object type. For example,the object can be listed as personal objects, such as keys or phones, aswell as type of object as a class such as listing all books that thewearer observes.

FIG. 8 illustrates an exemplary embodiment of the present invention thatwould operate in system 100 while employing methods 200 and 300. Asshown in Step 810, one user's point of view (here: “Joe's Wife”)observes a scene such as the location of keys and a patio table.Exemplarily, this scene is recorded in Step 812. Exemplarily, thecorrelation between the keys and the patio table are noted and taggedwithin the frame of the scene in Step 820. Next, in Step 822, thesesystem tags would be stored. Exemplarily, a database that stores tagsfor “my keys” and “patio table” would be updated with the current framein Step 830. The tags could also include time information, such as thedate (illustrated in this example as “yesterday”).

At another point in time (illustrated in this example as “today”),another use (“Joe”) would inquire about the location of “my keys” asexemplarily illustrated in Step 840. The user's words could be meant asa command or simply an observation. At Step 842, the wearable lensdevice could hear this command or observation. At Step 844, the systemcould exemplarily interpret the user's words or commands as a request todisplay “my keys”. Exemplarily, tags related to “keys” or “my keys”could be searched and an appropriate frame could be retrieved in Step846. In Step 850, the user's frame would return his most recentobservation of “my keys”. In this example, the frame could be overlaidwith a notation that this frame is not the most recent location of “mykeys” and in Step 856 a more recent frame could be retrieved. Thus, theother user's more recent frame can be presented in Step 860.

While for purposes of simplicity of explanation, the respectiveprocesses are shown and described as a series of blocks in FIGS. 2, 3,and 8, it is to be understood and appreciated that the claimed subjectmatter is not limited by the order of the blocks, as some blocks mayoccur in different orders and/or concurrently with other blocks fromwhat is depicted and described herein. Moreover, not all illustratedblocks may be required to implement the methods described herein.

FIG. 4 depicts an illustrative embodiment of a communication system 400for providing various communication services, such as delivering mediacontent. The communication system 400 can represent an interactive medianetwork, such as an interactive television system (e.g., an InternetProtocol Television (IPTV) media system). Communication system 400 canbe overlaid or operably coupled with system 100 of FIG. 1 as anotherrepresentative embodiment of communication system 400. For instance, oneor more devices illustrated in the communication system 400 of FIG. 4can perform a method including observing a plurality of objects viewedthrough a smart lens, determining an identification for an object of theplurality of objects, assigning a tag for the object based on theidentification, obtaining a trigger related to the object, obtaininglocation information for the object, storing the trigger, the tag, andthe location information for the object, receiving a recall requestbased on the trigger related to the object, retrieving the tag and thelocation information for the object responsive to the receiving therecall request, and providing the tag and the location information to auser that provided the recall request.

In one or more embodiments, the communication system 400 can include asuper head-end office (SHO) 410 with at least one super headend officeserver (SHS) 411 which receives media content from satellite and/orterrestrial communication systems. In the present context, media contentcan represent, for example, audio content, moving image content such as2D or 3D videos, video games, virtual reality content, still imagecontent, and combinations thereof. The SHS server 411 can forwardpackets associated with the media content to one or more video head-endservers (VHS) 414 via a network of video head-end offices (VHO) 412according to a multicast communication protocol. The VHS 414 candistribute multimedia broadcast content via an access network 418 tocommercial and/or residential buildings 402 housing a gateway 404 (suchas a residential or commercial gateway).

The access network 418 can represent a group of digital subscriber lineaccess multiplexers (DSLAMs) located in a central office or a servicearea interface that provide broadband services over fiber optical linksor copper twisted pairs 419 to buildings 402. The gateway 404 can usecommunication technology to distribute broadcast signals to mediaprocessors 406 such as Set-Top Boxes (STBs) which in turn presentbroadcast channels to media devices 408 such as computers or televisionsets managed in some instances by a media controller 407 (such as aninfrared or RF remote controller).

The gateway 404, the media processors 406, and media devices 408 canutilize tethered communication technologies (such as coaxial, powerlineor phone line wiring) or can operate over a wireless access protocolsuch as Wireless Fidelity (WiFi), Bluetooth®, Zigbee®, or other presentor next generation local or personal area wireless network technologies.By way of these interfaces, unicast communications can also be invokedbetween the media processors 406 and subsystems of the IPTV media systemfor services such as video-on-demand (VoD), browsing an electronicprogramming guide (EPG), or other infrastructure services.

A satellite broadcast television system 429 can be used in the mediasystem of FIG. 4. The satellite broadcast television system can beoverlaid, operably coupled with, or replace the IPTV system as anotherrepresentative embodiment of communication system 400. In thisembodiment, signals transmitted by a satellite 415 that include mediacontent can be received by a satellite dish receiver 431 coupled to thebuilding 402. Modulated signals received by the satellite dish receiver431 can be transferred to the media processors 406 for demodulating,decoding, encoding, and/or distributing broadcast channels to the mediadevices 408. The media processors 406 can be equipped with a broadbandport to an Internet Service Provider (ISP) network 432 to enableinteractive services such as VoD and EPG as described above.

In yet another embodiment, an analog or digital cable broadcastdistribution system such as cable TV system 433 can be overlaid,operably coupled with, or replace the IPTV system and/or the satelliteTV system as another representative embodiment of communication system400. In this embodiment, the cable TV system 433 can also provideInternet, telephony, and interactive media services. System 400 enablesvarious types of interactive television and/or services including IPTV,cable and/or satellite.

The subject disclosure can apply to other present or next generationover-the-air and/or landline media content services system.

Some of the network elements of the IPTV media system can be coupled toone or more computing devices 430, a portion of which can operate as aweb server for providing web portal services over the ISP network 432 towireline media devices 408 or wireless communication devices 416.

Communication system 400 can also provide for all or a portion of thecomputing devices 430 to function as a visual recall system (hereinreferred to as visual recall system 430). The visual recall system 430can use computing and communication technology to perform function 462,which can include among other things, the recollection of past viewedimages of method 300 of FIG. 3. For instance, function 462 of visualrecall system 430 can be similar to the functions described for therecollection of past viewed images of method 300 of FIG. 3. The mediaprocessors 406 and wireless communication devices 416 can be provisionedwith software functions 464 and 466, respectively, to utilize theservices of visual recall system 430. For instance, functions 464 and466 of media processors 406 and wireless communication devices 416 canbe similar to the functions described for the collection of past imagesof method 200 of FIG. 2.

Multiple forms of media services can be offered to media devices overlandline technologies such as those described above. Additionally, mediaservices can be offered to media devices by way of a wireless accessbase station 417 operating according to common wireless access protocolssuch as Global System for Mobile or GSM, Code Division Multiple Accessor CDMA, Time Division Multiple Access or TDMA, Universal MobileTelecommunications or UMTS, World interoperability for Microwave orWiMAX, Software Defined Radio or SDR, Long Term Evolution or LTE, and soon. Other present and next generation wide area wireless access networktechnologies can be used in one or more embodiments of the subjectdisclosure.

FIG. 5 depicts an illustrative embodiment of a web portal 502 of acommunication system 500. Communication system 500 can be overlaid oroperably coupled with system 100 of FIG. 1 and communication system 400as another representative embodiment of system 100 of FIG. 1 andcommunication system 400. The web portal 502 can be used for managingservices of controller 122 and local device 110 of FIG. 1 andcommunication systems 400. A web page of the web portal 502 can beaccessed by a Uniform Resource Locator (URL) with an Internet browserusing an Internet-capable communication device such as those describedin local device 110 of FIG. 1 and communication device 400 of FIG. 4.The web portal 502 can be configured, for example, to access a mediaprocessor 406 and services managed thereby such as a Digital VideoRecorder (DVR), a Video on Demand (VoD) catalog, an ElectronicProgramming Guide (EPG), or a personal catalog (such as personal videos,pictures, audio recordings, etc.) stored at the media processor 406. Theweb portal 502 can also be used for provisioning IMS services describedearlier, provisioning Internet services, provisioning cellular phoneservices, and so on.

The web portal 502 can further be utilized to manage and provisionsoftware applications 462, 464, and 466 to adapt these applications asmay be desired by subscribers and/or service providers of system 100 ofFIG. 1 and communication system 400. For instance, users of the servicesprovided by cloud system 120 or visual recall system 430 can log intotheir on-line accounts and provision the servers or visual recall systemthrough their mobile communication devices, tables, or through aninteraction with the local device 110, and so on. Service providers canlog onto an administrator account to provision, monitor and/or maintainthe system 100 of FIG. 1 or visual recall system 430.

FIG. 6 depicts an illustrative embodiment of a communication device 600.Communication device 600 can serve in whole or in part as anillustrative embodiment of the devices depicted in system 100 of FIG. 1and communication system 400 and can be configured to perform portionsof methods 200 and 300 of FIGS. 2 and 3.

Communication device 600 can comprise a wireline and/or wirelesstransceiver 602 (herein transceiver 602), a user interface (UI) 604, apower supply 614, a location receiver 616, a motion sensor 618, anorientation sensor 620, and a controller 606 for managing operationsthereof The transceiver 602 can support short-range or long-rangewireless access technologies such as Bluetooth®, ZigBee®, WiFi, DECT, orcellular communication technologies, just to mention a few (Bluetooth®and ZigBee® are trademarks registered by the Bluetooth® Special InterestGroup and the ZigBee® Alliance, respectively). Cellular technologies caninclude, for example, CDMA-1×, UMTS/HSDPA, GSM/GPRS, TDMA/EDGE, EV/DO,WiMAX, SDR, LTE, as well as other next generation wireless communicationtechnologies as they arise. The transceiver 602 can also be adapted tosupport circuit-switched wireline access technologies (such as PSTN),packet-switched wireline access technologies (such as TCP/IP, VoIP,etc.), and combinations thereof

The UI 604 can include a depressible or touch-sensitive keypad 608 witha navigation mechanism such as a roller ball, a joystick, a mouse, or anavigation disk for manipulating operations of the communication device600. The keypad 608 can be an integral part of a housing assembly of thecommunication device 600 or an independent device operably coupledthereto by a tethered wireline interface (such as a USB cable) or awireless interface supporting for example Bluetooth®. The keypad 608 canrepresent a numeric keypad commonly used by phones, and/or a QWERTYkeypad with alphanumeric keys. The UI 604 can further include a display610 such as monochrome or color LCD (Liquid Crystal Display), OLED(Organic Light Emitting Diode) or other suitable display technology forconveying images to an end user of the communication device 600. In anembodiment where the display 610 is touch-sensitive, a portion or all ofthe keypad 608 can be presented by way of the display 610 withnavigation features.

The display 610 can use touch screen technology to also serve as a userinterface for detecting user input. As a touch screen display, thecommunication device 600 can be adapted to present a user interface withgraphical user interface (GUI) elements that can be selected by a userwith a touch of a finger. The touch screen display 610 can be equippedwith capacitive, resistive or other forms of sensing technology todetect how much surface area of a user's finger has been placed on aportion of the touch screen display. This sensing information can beused to control the manipulation of the GUI elements or other functionsof the user interface. The display 610 can be an integral part of thehousing assembly of the communication device 600 or an independentdevice communicatively coupled thereto by a tethered wireline interface(such as a cable) or a wireless interface.

The UI 604 can also include an audio system 612 that utilizes audiotechnology for conveying low volume audio (such as audio heard inproximity of a human ear) and high volume audio (such as speakerphonefor hands free operation). The audio system 612 can further include amicrophone for receiving audible signals of an end user. The audiosystem 612 can also be used for voice recognition applications. The UI604 can further include an image sensor 613 such as a charged coupleddevice (CCD) camera for capturing still or moving images.

The power supply 614 can utilize common power management technologiessuch as replaceable and rechargeable batteries, supply regulationtechnologies, and/or charging system technologies for supplying energyto the components of the communication device 600 to facilitatelong-range or short-range portable applications. Alternatively, or incombination, the charging system can utilize external power sources suchas DC power supplied over a physical interface such as a USB port orother suitable tethering technologies.

The location receiver 616 can utilize location technology such as aglobal positioning system (GPS) receiver capable of assisted GPS foridentifying a location of the communication device 600 based on signalsgenerated by a constellation of GPS satellites, which can be used forfacilitating location services such as navigation. The motion sensor 618can utilize motion sensing technology such as an accelerometer, agyroscope, or other suitable motion sensing technology to detect motionof the communication device 600 in three-dimensional space. Theorientation sensor 620 can utilize orientation sensing technology suchas a magnetometer to detect the orientation of the communication device600 (north, south, west, and east, as well as combined orientations indegrees, minutes, or other suitable orientation metrics).

The communication device 600 can use the transceiver 602 to alsodetermine a proximity to a cellular, WiFi, Bluetooth®, or other wirelessaccess points by sensing techniques such as utilizing a received signalstrength indicator (RSSI) and/or signal time of arrival (TOA) or time offlight (TOF) measurements. The controller 606 can utilize computingtechnologies such as a microprocessor, a digital signal processor (DSP),programmable gate arrays, application specific integrated circuits,and/or a video processor with associated storage memory such as Flash,ROM, RAM, SRAM, DRAM or other storage technologies for executingcomputer instructions, controlling, and processing data supplied by theaforementioned components of the communication device 600.

Other components not shown in FIG. 6 can be used in one or moreembodiments of the subject disclosure. For instance, the communicationdevice 600 can include a reset button (not shown). The reset button canbe used to reset the controller 606 of the communication device 600. Inyet another embodiment, the communication device 600 can also include afactory default setting button positioned, for example, below a smallhole in a housing assembly of the communication device 600 to force thecommunication device 600 to re-establish factory settings. In thisembodiment, a user can use a protruding object such as a pen or paperclip tip to reach into the hole and depress the default setting button.The communication device 600 can also include a slot for adding orremoving an identity module such as a Subscriber Identity Module (SIM)card. SIM cards can be used for identifying subscriber services,executing programs, storing subscriber data, and so forth.

The communication device 600 as described herein can operate with moreor less of the circuit components shown in FIG. 6. These variantembodiments can be used in one or more embodiments of the subjectdisclosure.

The communication device 600 can be adapted to perform the functions of[system 100 of FIG. 1, the media processor 406, the media devices 408,or the portable communication devices 416 of FIG. 4. It will beappreciated that the communication device 600 can also represent otherdevices that can operate in system 100 of FIG. 1 and communicationsystem 400 of FIG. 4 such as a gaming console and a media player. Inaddition, the controller 606 can be adapted in various embodiments toperform the functions 462, 464, and 466, respectively.

Upon reviewing the aforementioned embodiments, it would be evident to anartisan with ordinary skill in the art that said embodiments can bemodified, reduced, or enhanced without departing from the scope of theclaims described below. For example, in some embodiments, the wearablelenses can be recorded and monitored for persons other than the wearer.For example, a parent can monitor the activities and objects viewed byfriends, family members, and children. In other embodiments, pets can beprovided with their own wearable lenses so that the objects and placesthey explore can be categorized as well. That is, in some embodiments,the user can observe objects that other wearers observe to learn theplacement of objects that are encountered. Other embodiments can be usedin the subject disclosure.

It should be understood that devices described in the exemplaryembodiments can be in communication with each other via various wirelessand/or wired methodologies. The methodologies can be links that aredescribed as coupled, connected and so forth, which can includeunidirectional and/or bidirectional communication over wireless pathsand/or wired paths that utilize one or more of various protocols ormethodologies, where the coupling and/or connection can be direct (e.g.,no intervening processing device) and/or indirect (e.g., an intermediaryprocessing device such as a router).

FIG. 7 depicts an exemplary diagrammatic representation of a machine inthe form of a computer system 700 within which a set of instructions,when executed, may cause the machine to perform any one or more of themethods described above. One or more instances of the machine canoperate, for example, as the visual recall system 430, the mediaprocessor 406, as well as the local device 110 (i.e., the wearable lensdevice) of FIG. 1. In some embodiments, the machine may be connected(e.g., using a network 726) to other machines. In a networkeddeployment, the machine may operate in the capacity of a server or aclient user machine in a server-client user network environment, or as apeer machine in a peer-to-peer (or distributed) network environment.

The machine may comprise a server computer, a client user computer, apersonal computer (PC), a tablet, a smart phone, a laptop computer, adesktop computer, a control system, a network router, switch or bridge,or any machine capable of executing a set of instructions (sequential orotherwise) that specify actions to be taken by that machine. It will beunderstood that a communication device of the subject disclosureincludes broadly any electronic device that provides voice, video ordata communication. Further, while a single machine is illustrated, theterm “machine” shall also be taken to include any collection of machinesthat individually or jointly execute a set (or multiple sets) ofinstructions to perform any one or more of the methods discussed herein.

The computer system 700 may include a processor (or controller) 702(e.g., a central processing unit (CPU)), a graphics processing unit(GPU, or both), a main memory 704 and a static memory 706, whichcommunicate with each other via a bus 708. The computer system 700 mayfurther include a display unit 710 (e.g., a liquid crystal display(LCD), a flat panel, or a solid state display). The computer system 700may include an input device 712 (e.g., a keyboard), a cursor controldevice 714 (e.g., a mouse), a disk drive unit 716, a signal generationdevice 718 (e.g., a speaker or remote control) and a network interfacedevice 720. In distributed environments, the embodiments described inthe subject disclosure can be adapted to utilize multiple display units710 controlled by two or more computer systems 700. In thisconfiguration, presentations described by the subject disclosure may inpart be shown in a first of the display units 710, while the remainingportion is presented in a second of the display units 710.

The disk drive unit 716 may include a tangible computer-readable storagemedium 722 on which is stored one or more sets of instructions (e.g.,software 724) embodying any one or more of the methods or functionsdescribed herein, including those methods illustrated above. Theinstructions 724 may also reside, completely or at least partially,within the main memory 704, the static memory 706, and/or within theprocessor 702 during execution thereof by the computer system 700. Themain memory 704 and the processor 702 also may constitute tangiblecomputer-readable storage media.

Dedicated hardware implementations including, but not limited to,application specific integrated circuits, programmable logic arrays andother hardware devices can likewise be constructed to implement themethods described herein. Application specific integrated circuits andprogrammable logic array can use downloadable instructions for executingstate machines and/or circuit configurations to implement embodiments ofthe subject disclosure. Applications that may include the apparatus andsystems of various embodiments broadly include a variety of electronicand computer systems. Some embodiments implement functions in two ormore specific interconnected hardware modules or devices with relatedcontrol and data signals communicated between and through the modules,or as portions of an application-specific integrated circuit. Thus, theexample system is applicable to software, firmware, and hardwareimplementations.

In accordance with various embodiments of the subject disclosure, theoperations or methods described herein are intended for operation assoftware programs or instructions running on or executed by a computerprocessor or other computing device, and which may include other formsof instructions manifested as a state machine implemented with logiccomponents in an application specific integrated circuit or fieldprogrammable gate array. Furthermore, software implementations (e.g.,software programs, instructions, etc.) including, but not limited to,distributed processing or component/object distributed processing,parallel processing, or virtual machine processing can also beconstructed to implement the methods described herein. Distributedprocessing environments can include multiple processors in a singlemachine, single processors in multiple machines, and/or multipleprocessors in multiple machines. It is further noted that a computingdevice such as a processor, a controller, a state machine or othersuitable device for executing instructions to perform operations ormethods may perform such operations directly or indirectly by way of oneor more intermediate devices directed by the computing device.

While the tangible computer-readable storage medium 722 is shown in anexample embodiment to be a single medium, the term “tangiblecomputer-readable storage medium” should be taken to include a singlemedium or multiple media (e.g., a centralized or distributed database,and/or associated caches and servers) that store the one or more sets ofinstructions. The term “tangible computer-readable storage medium” shallalso be taken to include any non-transitory medium that is capable ofstoring or encoding a set of instructions for execution by the machineand that cause the machine to perform any one or more of the methods ofthe subject disclosure. The term “non-transitory” as in a non-transitorycomputer-readable storage includes without limitation memories, drives,devices and anything tangible but not a signal per se.

The term “tangible computer-readable storage medium” shall accordinglybe taken to include, but not be limited to: solid-state memories such asa memory card or other package that houses one or more read-only(non-volatile) memories, random access memories, or other re-writable(volatile) memories, a magneto-optical or optical medium such as a diskor tape, or other tangible media which can be used to store information.Accordingly, the disclosure is considered to include any one or more ofa tangible computer-readable storage medium, as listed herein andincluding art-recognized equivalents and successor media, in which thesoftware implementations herein are stored.

Although the present specification describes components and functionsimplemented in the embodiments with reference to particular standardsand protocols, the disclosure is not limited to such standards andprotocols. Each of the standards for Internet and other packet switchednetwork transmission (e.g., TCP/IP, UDP/IP, HTML, HTTP) representexamples of the state of the art. Such standards are from time-to-timesuperseded by faster or more efficient equivalents having essentiallythe same functions. Wireless standards for device detection (e.g.,RFID), short-range communications (e.g., Bluetooth®, WiFi, Zigbee®), andlong-range communications (e.g., WiMAX, GSM, CDMA, LTE) can be used bycomputer system 700. In one or more embodiments, information regardinguse of services can be generated including services being accessed,media consumption history, user preferences, and so forth. Thisinformation can be obtained by various methods including user input,detecting types of communications (e.g., video content vs. audiocontent), analysis of content streams, and so forth. The generating,obtaining and/or monitoring of this information can be responsive to anauthorization provided by the user. In one or more embodiments, ananalysis of data can be subject to authorization from user(s) associatedwith the data, such as an opt-in, an opt-out, acknowledgementrequirements, notifications, selective authorization based on types ofdata, and so forth.

The illustrations of embodiments described herein are intended toprovide a general understanding of the structure of various embodiments,and they are not intended to serve as a complete description of all theelements and features of apparatus and systems that might make use ofthe structures described herein. Many other embodiments will be apparentto those of skill in the art upon reviewing the above description. Theexemplary embodiments can include combinations of features and/or stepsfrom multiple embodiments. Other embodiments may be utilized and derivedtherefrom, such that structural and logical substitutions and changesmay be made without departing from the scope of this disclosure. Figuresare also merely representational and may not be drawn to scale. Certainproportions thereof may be exaggerated, while others may be minimized.Accordingly, the specification and drawings are to be regarded in anillustrative rather than a restrictive sense.

Although specific embodiments have been illustrated and describedherein, it should be appreciated that any arrangement which achieves thesame or similar purpose may be substituted for the embodiments describedor shown by the subject disclosure. The subject disclosure is intendedto cover any and all adaptations or variations of various embodiments.Combinations of the above embodiments, and other embodiments notspecifically described herein, can be used in the subject disclosure.For instance, one or more features from one or more embodiments can becombined with one or more features of one or more other embodiments. Inone or more embodiments, features that are positively recited can alsobe negatively recited and excluded from the embodiment with or withoutreplacement by another structural and/or functional feature. The stepsor functions described with respect to the embodiments of the subjectdisclosure can be performed in any order. The steps or functionsdescribed with respect to the embodiments of the subject disclosure canbe performed alone or in combination with other steps or functions ofthe subject disclosure, as well as from other embodiments or from othersteps that have not been described in the subject disclosure. Further,more than or less than all of the features described with respect to anembodiment can also be utilized.

Less than all of the steps or functions described with respect to theexemplary processes or methods can also be performed in one or more ofthe exemplary embodiments. Further, the use of numerical terms todescribe a device, component, step or function, such as first, second,third, and so forth, is not intended to describe an order or functionunless expressly stated so. The use of the terms first, second, thirdand so forth, is generally to distinguish between devices, components,steps or functions unless expressly stated otherwise. Additionally, oneor more devices or components described with respect to the exemplaryembodiments can facilitate one or more functions, where the facilitating(e.g., facilitating access or facilitating establishing a connection)can include less than every step needed to perform the function or caninclude all of the steps needed to perform the function.

In one or more embodiments, a processor (which can include a controlleror circuit) has been described that performs various functions. Itshould be understood that the processor can be multiple processors,which can include distributed processors or parallel processors in asingle machine or multiple machines. The processor can be used insupporting a virtual processing environment. The virtual processingenvironment may support one or more virtual machines representingcomputers, servers, or other computing devices. In such virtualmachines, components such as microprocessors and storage devices may bevirtualized or logically represented. The processor can include a statemachine, application specific integrated circuit, and/or programmablegate array including a Field PGA. In one or more embodiments, when aprocessor executes instructions to perform “operations”, this caninclude the processor performing the operations directly and/orfacilitating, directing, or cooperating with another device or componentto perform the operations.

The Abstract of the Disclosure is provided with the understanding thatit will not be used to interpret or limit the scope or meaning of theclaims. In addition, in the foregoing Detailed Description, it can beseen that various features are grouped together in a single embodimentfor the purpose of streamlining the disclosure. This method ofdisclosure is not to be interpreted as reflecting an intention that theclaimed embodiments require more features than are expressly recited ineach claim. Rather, as the following claims reflect, inventive subjectmatter lies in less than all features of a single disclosed embodiment.Thus the following claims are hereby incorporated into the DetailedDescription, with each claim standing on its own as a separately claimedsubject matter.

What is claimed is:
 1. A method, comprising: replacing, by a processingsystem comprising a processor, first tag information of a framecorresponding to an object with second tag information, wherein thereplacing is performed based upon detecting the object in an imagecaptured by a smart lens; and responsive to a request determined tocorrespond to the object, causing, by the processing system, the secondtag information and the frame to be presented to facilitate on demandrecall of a location of the object.
 2. The method of claim 1, furthercomprising causing advertising content to be presented.
 3. The method ofclaim 1, wherein the image is included in video content recorded by thesmart lens.
 4. The method of claim 1, further comprising obtaining, bythe processing system, the second tag information.
 5. The method ofclaim 1, further comprising: identifying, by the processing system, asecond observed object within a second frame of a second image capturedby the smart lens; determining, by the processing system, whetheradvertising content exists for the second observed object; andresponsive to a determination that the advertising content exists forthe second observed object, displaying, by the processing system, theadvertising content.
 6. The method of claim 5, further comprisingactivating an advertising session for the second observed object.
 7. Themethod of claim 1, wherein the request corresponds to verbal inputreceived via a microphone.
 8. The method of claim 1, wherein the requestcorresponds to a user request for the location of the object.
 9. Adevice, comprising: a processing system including a processor; and amemory that stores executable instructions that, when executed by theprocessing system, facilitate performance of operations comprising:substituting second tag information for first tag information of a framecorresponding to an object, wherein the substituting is in accordancewith identifying the object in an image captured by a smart lens; andresponsive to a request for the object, causing the second taginformation and the frame to be presented.
 10. The device of claim 9,wherein the operations further comprise activating an advertisingsession for the object.
 11. The device of claim 9, wherein the framecomprises one of a plurality of frames of video content recorded by thesmart lens.
 12. The device of claim 9, wherein the operations furthercomprise obtaining the second tag information.
 13. The device of claim9, wherein the operations further comprise: identifying a secondobserved object within a second frame of a second image captured by thesmart lens; determining whether second advertising content exists forthe second observed object; and responsive to a determination that thesecond advertising content exists for the second observed object,displaying the second advertising content.
 14. The device of claim 9,wherein the request corresponds to verbal input received via amicrophone.
 15. The device of claim 9, wherein the request correspondsto a user request for a location of the object.
 16. A non-transitorymachine-readable medium comprising executable instructions that, whenexecuted by a processing system including a processor, facilitateperformance of operations comprising: replacing first tag information ofa frame corresponding to an object with second tag information, whereinthe replacing is based on detecting the object in an image captured by asmart lens; and responsive to a verbal request for the object,presenting the second tag information, the frame, and content related tothe object.
 17. The non-transitory machine-readable medium of claim 16,wherein the content comprises advertising content.
 18. Thenon-transitory machine-readable medium of claim 16, wherein the verbalrequest corresponds to a user request for a location of the object. 19.The non-transitory machine-readable medium of claim 16, wherein theoperations further comprise: identifying a second observed object withina second frame of a second image captured by the smart lens; determiningwhether advertising content exists for the second observed object; andresponsive to a determination that the advertising content exists forthe second observed object, displaying the advertising content.
 20. Thenon-transitory machine-readable medium of claim 19, wherein theoperations further comprise activating an advertising session for thesecond observed object.